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Abstract. In this paper, we conduct a fitness landscape analysis for 
multiobjective combinatorial optimization, based on the local optima 
of multiobjective A^Tf-landscapes with objective correlation. In single- 
objective optimization, it has become clear that local optima have a 
strong impact on the performance of metaheuristics. Here, we propose 
an extension to the multiobjective case, based on the Pareto dominance. 
We study the co-influence of the problem dimension, the degree of non- 
linearity, the number of objectives and the correlation degree between 
objective functions on the number of Pareto local optima. 



1 Motivations 

The aim of fitness landscape analysis is to understand the properties of a given 
combinatorial optimization problem in order to design efficient search algo- 
rithms. One of the main feature is related to the number of local optima, to 
their distribution over the search space and to the shape of their basins of at- 
traction. For instance, in single-objective optimization, it has been shown that 
local optima tend to be clustered in a 'central massif for numerous combina- 
torial problems, such as the family of A^isT- landscapes [T]. A lot of methods are 
designed to 'escape' from such local optima. However, very little is known in 
the frame of multiobjective combinatorial optimization (MoCO), where one of 
the most challenging question relies on the identification of the set of Pareto 
optimal solutions. A Pareto Local Optima (PLO) [5] is a solution that is not 
dominated by any of its neighbors. The description of PLO is one of the first 
fundamental step towards the description of the structural properties of a MoCO 
problem. Surprisingly, up to now, there is a lack of study on the number and on 
the distribution of PLO in MoCO. 

Like in single-objective optimization, the PLO-related properties clearly have 
a strong impact on the landscape of the problem, and then on the efficiency of 
search algorithms. In particular, local search algorithms are designed in order to 
take them into account. For instance, the family of Pareto Local Search (PLS) [2] 
iteratively improves a set of solutions with respect to a given neighborhood 



operator and to the Pareto dominance relation. The aim of PLS, hkc a number 
of other search algorithms, is to find a set of mutually non-dominated FLO. 
PLS has been proved to terminate on such a set, called a Pareto local optimum 
set P]- Notice that a Pareto optimal solution is a PLO, and that the whole 
set of Pareto optimal solutions is a Pareto local optimum set. The behavior of 
multiobjectivc algorithms clearly depends on the properties related to the PLO. 
First, a Pareto local optimum set is always a subset of the whole set of PLO. 
Second, the dynamics of a PLS-like algorithm depends of the number of PLO 
found along the search process. The probability to improve an approximation 
set that contains a majority of PLO should be smaller than the probability to 
improve an approximation set with few PLO. 

There exists a small amount of literature related to fitness landscape for 
MoCO. Borges and Hansen [3] study the distribution of local optima, in terms 
of scalarized functions, for the multiobjectivc traveling salesman problem (TSP). 
Another analysis of neighborhood-related properties for biobjective TSP in- 
stances of different structures is given in [3] . Knowles and Corne [S] lead a land- 
scape analysis on the multiobjectivc quadratic assignment problem with a rough 
objective correlation. Next, the transposition of standard tools from fitness land- 
scape analysis to MoCO are discussed by Garrett [5], and an experimental study 
is conducted with fitness distance correlation. But this measure requires the true 
Pareto optimal set to be known. In another study, the landscape of a MoCO 
problem is regarded as a neutral landscape, and divided into different fronts 
with the same dominance rank [3. In such small search space needs to 

be enumerated. In previous works on multiobjectivc iV_ftr-landscapes by Aguirre 
and Tanaka [8] , small enumerable fitness landscapes are studied according to the 
number of fronts, the number of solutions on each front, the probability to pass 
from one front to another, and the hypervolume of the Pareto front. However, 
the study of fronts simply allows to analyze small search spaces, and from the 
point of view of dominance rank only. 

In this work, our attempt is to analyze the structure of large search space 
using the central notion of local optimum. For the design of a local search 
algorithm for MoCO, the following questions are under study in this paper: 
(i) What is the number of PLO in the whole search space? (m) Is the number of 
PLO related to the number of Pareto optimal solutions? In particular wc want 
to study such properties according to the correlation degree between objective 
functions. In order to study the problem structure, and in particular the PLO, 
we use the multiobjectivc A^ii'-landscapes with objective correlation, pMNK- 
landscapes for short, recently proposed in [9]. The contributions of this work can 
be summarized as follows. First, we show the co-influence of objective correla- 
tion, objective space dimension and epistasis on the number of PLO. Next, we 
propose a method based on the length of a Pareto adaptive walk to estimate 
this number. At last, we study the number of PLO for large-size instances. 

The paper is organized as follows. Section [5] deals with MoCO and local 
search algorithms. Section [3] is devoted to the definition of multiobjectivc NK- 
landscapes with objective correlation. In Section SI wc study the number of PLO 



for enumerable instances and we propose a method to estimate it. Moreover, 
we analyze the correlation between the number of PLO and Pareto optimal 
solutions. In Section [SJ the co-influence of objective space dimension, objective 
correlation and epistasis is studied for the PLO of large-size instances. The last 
section concludes the paper. 

2 Local Search for Multiobjective Combinatorial 
Optimization 

2.1 Multiobjective Combinatorial Optimization 

A multiobjective combinatorial optimization (MoCO) problem can be defined 
by a set of M > 2 objective functions (/i, /2, . . . , /m), and a (discrete) set X 
of feasible solutions in the decision space. Let Z = f{X) C R^^ be the set of 
feasible outcome vectors in the objective space. In a maximization context, a 
solution x' £ X IS dominated by a solution x ^ X, denoted by x' -< x, iff Vi G 
{1,2,...,M}, U{x') < Mx) and 3j G {1,2,...,M} such that < 
A solution X £ X is said to be Pareto optimal (or efficient, non- dominated), if 
there does not exist any other solution x' £ X such that x' dominates x. The set 
of all Pareto optimal solutions is called the Pareto optimal set (or the efficient 
set), denoted by Xe, and its mapping in the objective space is called the Pareto 
front. A possible approach in MoCO is to identify the minimal complete Pareto 
optimal set, i.e. one solution mapping to each point of the Pareto front. However, 
the overall goal is often to identify a good Pareto set approximation. To this 
end, metaheuristics in general, and evolutionary algorithms in particular, have 
received a growing interest since the late eighties. Multiobjective metaheuristics 
still constitute an active research area [10) . 

2.2 Local Search 

A neighborhood structure is a function M : X 2^ that assigns a set of solutions 
J\f{x) C X to any solution x G X. The set N{x) is called the neighborhood of x, 
and a solution x' G J\f{x) is called a neighbor of x. In single-objective combina- 
torial optimization, a fitness landscape can be defined by the triplet {X,Af,h), 
where h : X — > H represents the fitness function, that can be pictured as the 
height of the corresponding solutions. Each peak of the landscape corresponds 
to a local optimum. In a single-objective maximization context, a local optimum 
is a solution x* such that Vx G A/'(x*), f{x) < f{x*). The ability of local search 
algorithms has been shown to be related to the number of local optima for the 
problem under study, and to their distribution over the landscapes 

In MoCO, given that Pareto optimal solutions are to be found, the notion of 
local optimum has to be defined in terms of Pareto optimality. Let us define the 
concepts of Pareto local optimum and of Pareto local optimum set. For more de- 
tails, refer to [2]. A solution x G X is a. Pareto local optimum (PLO) with respect 
to a neighborhood structure Af if there does not exist any neighboring solution 



x' £ Mix) such that x < x' . K Pareto local optimum set Xp^o G X with respect 
to a neighborhood structure A/" is a set of niutuaUy non-dominated solutions such 
that Vx G XpLOi there does not exist any solution x' £ J\f{XpLo) such that 
x ^ x' . In other words, a locally Pareto optimal set cannot be improved, in terms 
of Pareto optimality, by adding solutions from its neighborhood. 

Recently, local search algorithms have been successfully applied to MoCO 
problems. Such methods seem to take advantage of some properties of the land- 
scape in order to explore the search space in an effective way. Two main classes of 
local search for MoCO can be distinguished. The first ones, known as scalar ap- 
proaches, arc based on multiple scalarized aggregations of the objective functions. 
The second ones, known as Pareto-based approaches, directly or indirectly focus 
the search on the Pareto dominance relation (or a slight modification of it). One 
of them is the Pareto Local Search (PLS) [2]. It combines the use of a neighbor- 
hood structure with the management of an archive (or population) of mutually 
non-dominated solutions found so far. The basic idea is to iteratively improve 
this archive by exploring the neighborhood of its own content until no further 
improvement is possible, i.e. the archive falls in a Pareto local optimum set [5]. 

3 pM N K -Landscapes: Multiobjective A/^li'-Landscapes 
with Objective Correlation 

In single-objective optimization, the family of iVfsT-landscapes constitutes an 
interesting model to study the influence of non-linearity on the number of lo- 
cal optima. In this section, we present the pMiVii'-landscapes proposed in [S]. 
They are based on the MA^ If -landscapes [8]. In this multiobjective model, the 
correlation between objective functions can be precisely tuned by a correlation 
parameter value. 

3.1 NK- and MATJC-Landscapes 

The family of A^iC-landscapes [T] is a problem-independent model used for con- 
structing multimodal landscapes. N refers to the number of (binary) genes in 
the genotype {i.e. the string length) and K to the number of genes that influ- 
ence a particular gene from the string (the epistatic interactions) . By increasing 
the value of K from to {N — 1), iV/\-landscapes can be gradually tuned from 
smooth to rugged. The fitness function (to be maximized) of a A^fi'-landscape 
/nk ■ {0, 1}^ — > [0, 1) is defined on binary strings of size N. An 'atom' with 
fixed epistasis level is represented by a fitness component fi : {0, 1}^+^ — > [0, 1) 
associated to each bit i G iV. Its value depends on the allele at bit i and also 
on the alleles at K other epistatic positions {K must fall between and N — 1). 
The fitness fNK{x) of a solution x G {0, 1}^ corresponds to the mean value 
of its N fitness components /^i fNK{x) = ;^ Sili /^(^^i: ^j^^ , . . . , Xi^-^ ), where 
{ii, . . . , lA'} C {1, . . . , i — 1, 1 + 1, . . . , N}. In this work, we set the K bits ran- 
domly on the bit string of size N. Each fitness component fi is specified by 
extension, i.e. a number yx-^xi-^,...,xi^ from [0, 1) is associated with each element 



{xi,Xij^, . . . ,Xij^) from {0,1}^+^. Those numbers are uniformly distributed in 
the range [0, 1). 

More recently, a multiobjective variant of iVi^-landscapes (namely MNK- 
landscapes) [5] has been defined with a set of M fitness functions: 

1 ^ 

i=l 

The numbers of epistasis links Km can theoretically be different for each fitness 
function. But in practice, the same epistasis degree Km — K for all m G [1,^] 
is used. Each fitness component fm,i is specified by extension with the numbers 
Vxl'xi ^ xi -In- the original MA^iiT-landscapes [8], these numbers are ran- 
domly and independently drawn from [0, 1). As a consequence, it is very unlikely 
that two different solutions map to the same point in the objective space. 

3.2 pMATK-Landscapes 

In [3], CMiVi^r- landscapes have been proposed. The epistasis structure is iden- 
tical for all the objectives: Vm G [1, M], if^ = isT and Vm G [1, M], Vj G [l,K], 
im,j = ij- The fitness components are not defined independently. The num- 
bers iUx'^^xi-^ ,...,xi^ I • ■ • : Vxllxi^ ,---,xij^ ) follow a multivariate uniform law of dimen- 
sion M, defined by a correlation matrix C . Thus, the y's follow a multidimen- 
sional law with uniform marginals and the correlations between j/^'^s are defined 
by the matrix C. So, the four parameters of the family of CM A^ii'-landscapes 
are («) the number of objective functions M, {ii) the length of the bit string iV, 
{iii) the number of epistatic links K, and {iv) the correlation matrix C . 

In the pMA^ii'-landscapes, a matrix Cp = (c„p) is considered, with the same 
correlation between all the objectives: c„„ — 1 for all n, and c„p = p for all 
n ^ p. However, it is not possible to have the matrix Cp for all p between 
[— 1, 1]: p must be greater than ■jjri j see [9]. To generate random variables with 
uniform marginals and a specified correlation matrix C, we follow the work 
of Hotelling and Pabst [H]. The construction of CMTVif- landscapes defines 
correlation between the y's but not directly between the objectives. In [5], it is 
proven by algebra that the correlation between objectives is tuned by the matrix 
C: E(cor{fn, fp)) = Cnp- In pMA^ii'-landscape, the parameter p allows to tune 
very precisely the correlation between all pairs of objectives. 

4 Study of Pareto Local Optima 

In this section, we first study the number of Pareto local optima (PLO) accord- 
ing to the objective correlation, the number of objectives and the epistasis of 
/sMA/'JiT-landscapes. Then, we analyze its relation with the size of the Pareto 
optimal set. At last, we propose an adaptive walk that is able to estimate the 
number of PLO very precisely. We conduct an empirical study for iV = 18 so that 
we can enumerate all the PLO exhaustively. In order to minimize the influence of 



Table 1. Parameters used in the paper for the experimental analysis. 



Parameter 



Values 



N 
M 
K 



P 



{18} (Sectiongll , {18,32,64, 128} (Section[5l) 

{2,3,5} 

{2,4,6,8, 10} 

{-0.9, -0.7, -0.4, -0.2, 0.0, 0.2, 0.4, 0.7, 0.9} such that p > 



the random creation of landscapes, we considered 30 different and independent 
instances for each parameter combinations: p, M , and K . The measures reported 
are the average over these 30 landscapes. The parameters under investigation in 
this study are given in Table [TJ 

4.1 Number of Pareto Local Optima 

Fig. [T] shows the average number of PLO to the size of the search space {\X\ = 
2^^) for different pMNK-landscapes parameter settings. As the well-known result 
from single-objective iVif-landscapes [l], the number of PLO increases with the 
epistasis degree. For instance, with an objective space dimension AI = 2 and an 
objective correlation p = 0.9, the average number of PLO increases more than 
30 times: from 192 for K ^ 2 to 6048 for K ~ 10. However, the range of PLO 
is larger with respect to objective correlation. For the same epistatic degree and 
number of objectives, the number of PLO decreases exponentially (Fig.[l] top). 
Indeed, for an objective space dimension M = 2 and an epistasis degree K = 4, 
the average number of PLO decreases more than 120 times: from 82, 093 for 
negative correlation (p = —0.9) to 672 for positive correlation (p = 0.9). 

This result can be interpreted as follows. Let us consider an arbitrary so- 
lution X, and two different objective functions fi and fj. When the objective 
correlation is high, there is a high probability that fi{x) is close to fj{x). In 
the same way, the fitness values fi{x') and fj{x') of a given neighbor x' S N'{x) 
are probably close. So, for a given solution x such that it exists a neighbor 
x' € N{x) with a better /^-value, the probability is high that fj{x') is better 
than fj{x). More formally, the probability W{fj{x') > fj{x) \ fi{x') > fi{x)), 
with x' E M{x), increases with the objective correlation. Then, a solution x has 
a higher probability of being dominated when the objective correlation is high. 
Under this hypothesis, the probability that a solution dominates all its neigh- 
bors decreases with the number of objectives. Fig. [T] (bottom) corroborates this 
hypothesis. When the objective correlation is negative (p = —0.2), the number 
of PLO changes in an order of magnitude from M = 2 to A/ = 3, and from 
M = 3 to M = 5. This range is smaller when the correlation is positive. When 
the number of objective is large and the objective correlation is negative, almost 
all solutions are PLO. 

Assuming that the difficulty for Pareto-based search approaches gets higher 
when the number of PLO is large, the difficulty of pM A^if-landscapes increases 
when: (i) the epistasis increases, (ii) the number of objective functions increases, 




Fig. 1. Average number of PLO to the size of the search space {\X\ = 2^^) 
according to parameter p (top left M = 2, right M = 5), and to parameter K 
(bottom left p = -0.2, right p = 0.9). The problem size is = 18. 



(Hi) the objective correlation is negative, and its absolute value increases. Sec- 
tion [5] will precise the relative difficulty related to those parameters for large-size 
problem instances. 



4.2 Estimating the Cardinality of the Pareto Optimal Set? 

When the number of Pareto optimal solutions is too large, it becomes impossible 
to enumerate them all. A metaheuristic should then manipulate a limited-size 
solution set during the search. In this case, we have to design specific strategies to 
limit the size of the approximation set [13] . Hence, the cardinality of the Pareto 
optimal set also plays a major role in the design of multiobjcctive metaheuristics. 

In order to design such an approach, it would be convenient to approxi- 
mate the size of the Pareto optimal set from the number of PLO. Fig. [2] shows 
the scatter plot of the average size of the Pareto optimal set vs. the average 
number of PLO in log-scales. Points are scattered over the regression line with 
the Spearson correlation coefficient of 0.82, and the regression line equation is 
log(y) = alog(a;) + b with a = 1.059 and b = —6.536. For such a log-log scale, 
the correlation is low. It is only possible to estimate the cardinality of the Pareto 
optimal set from the number of PLO with a factor 10. Nevertheless, the number 
of Pareto optimal solutions clearly increases when the number of PLO increases. 



0.1 
0.01 

_ 0.001 

X 

— 0.0001 

X 

1e-05 
1e-06 
1e-07 

0.0001 0.001 0.01 0.1 1 

I XpLO I / 1 X I 

Fig. 2. Scatter plot of the average size of the Pareto optimal set (to the size 
of the search) vs. the average number of PLO (to the size of the search) for 
the 110 possible combinations of parameters. The problem size is iV = 18. The 
correlation coefficient is 0.82. Notice the log-scales. 



4.3 Adaptive Walk 

In single-objective optimization, the length of adaptive walks, performed with 
a hill-climber, allows to estimate the diameter of the local optima basins of 
attraction. Then, the number of local optima can be estimated when the whole 
search space cannot be enumerated exhaustively. In this section, we define a 
multiobjective hill-climber, and we show that the length of the corresponding 
adaptive walk is correlated to the number of PLO. We define a very basic single 
solution-based Pareto Hill- Climbing (PHC) for multiobjective optimization. A 
pseudo-code is given in Algorithm[T] At each iteration of the PHC algorithm, the 
current solution is replaced by one random neighbor solution which dominates 
it. So, the PHC stops on a PLO. The number of iterations, or steps, of the PHC 
algorithm is the length of the Pareto adaptive walk. 

We performed 10'^ independent PHC executions for each problem instance. 
Fig. [3] shows the average length of the Pareto adaptive walks for different land- 
scapes according to the set of parameters given in Table [TJ The variation of the 



Algorithm 1 Pareto Hill-Climbing (PHC) 
start with a random solution x £ X 
step 

while X is not a Pareto Local optimum do 
randomly choose x from {y £ M{x)\x -< y} 
X X 

step step -1-1 
end while 



M=2 
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M=5 
reg. line 




Fig. 3. Average length of the Parcto adaptive walk according to parameter p 
(top left M — 2, right M — 5), and according to parameter K (bottom left 
p = —0.2, right p ~ 0.9). The problem size is = 18. 



average length follows the opposite variation of the number of PLO. In order to 
show the link with the number of PLO more clearly, Fig. |4] gives the scatter-plot 
of the average Pareto adaptive length vs. the logarithm of the average number 
of PLO. The correlation is strong [r = 0.997), and the regression line equation 
is: log(j/) = ax + , with a = —1.095 and b — 12.443. For bit-string of length 
N = 18, the average length of the Pareto adaptive walks can then give a precise 
estimation of the average number of PLO. When the adaptive length is short, the 
diameter of the basin of attraction associated with a PLO is short. This means 
that the distance between PLO decreases. Moreover, assuming that the volume 
of this basin is proportional to a power of its diameter, the number of PLO 
increases exponentially when the adaptive length decreases. This corroborates 
known results from single-objective optimization. Of course, for larger bit-string 
length, the coefBcients are probably different. 

5 Properties vs. Multi-modality for Large-size Problems 

In this section, we study the number of PLO for large-size pMA'i^-landscapes 
using the length of the adaptive walk proposed in the previous section. First, we 
analyze this number according to the problem dimension (A'^). Then, we precise 
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Fig. 4. Scatter plot of the average number of PLO to the size of the search 
space {\X\ = 2^*) vs. the average length of the Pareto adaptive walk. The prob- 
lem size is iV = 18. 



the difficulty, in terms of PLO, with respect to objective space dimension (M) 
and objective correlation (p). 

We performed lO'' independent PHC executions for each problem instance. 
Fig. [5] shows the average length of the Pareto adaptive walks for different land- 
scapes according to the set of parameters given in Table [T] Whatever the objec- 
tive space dimension and correlation, the length of the adaptive walks increases 
linearly with the search space dimension N. According to the results from the 
previous section, the number of PLO increases exponentially. We can then rea- 
sonably conclude that the size of the Pareto optimal set grows exponentially as 
well, to an order of magnitude (Section 14. 2p . However, the slope of the Pareto 
adaptive length increase is related to the objective space dimension (M) and 
correlation (p). The higher the number of objective functions, the smaller the 
slope. As well, the higher the objective correlation, the smaller the slope. 

Fig. [5] (bottom) allows us to give a qualitative comparison for given problem 
sizes {N = 64 and N = 128). Indeed, let us consider an arbitrary adaptive 
walk of length 10. For pA/A^A'-landscapes with = 64 and K ~ A, this length 
corresponds approximately to parameters {p = — 0.4, M = 2), {p ~ 0.3, A/ = 
3), and {p = 0.7, M = 5) at the same time. For A^ = 128, we have (p = 
-0.9, M = 2), {p = -0.1, M = 3), and (p = 0.3, M = 5). Still assuming that 
a problem difficulty is closely related to the number of PLO, an instance with 
a small objective space dimension and a negative objective correlation can be 
more difficult to solve than with many correlated objectives. 



6 Discussion 



This paper gives a fitness landscape analysis for multiobjective combinatorial 
optimization based on the local optima of multiobjective A'^AT-landscapes with 
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Fig. 5. Average length of the Pareto adaptive walk according to problem size 
(N) for K = 4 and p = -0.2 (top-left) and for K ^ A and M = 2 (top-right). 
Average length of the Pareto adaptive walk according to objective correlation (p) 
for JsT = 4 and TV = 64 (bottom- left) and iov K = A and TV = 128 (bottom-right). 



objective correlation. We first focused on small-size problems with a study of the 
number of local optima by complete enumeration. Like in single-objective opti- 
mization, the number of local optima increases with the degree of non-linearity 
of the problem (epistasis). However, the number of objective functions and the 
objective correlation have a stronger influence. Futhermore, our results show 
that the cardinality of the Pareto optimal set clearly increases with the number 
of local optima. We proposed a Pareto adaptive walk, associated with a Pareto 
hill-climber, to estimate the number of local optima for a given problem size. 
Next, for large-size instances, the length of such Pareto adaptive walk can give a 
measure related to the difficulty of a multiobjective combinatorial optimization 
problem. We show that this measure increases exponentially with the problem 
size. A problem with a small number of negatively correlated objectives gives 
the same degree of multi-modality, in terms of Pareto dominance, than another 
problem with a high objective space dimension and a positive correlation. 

A similar analysis would allow to better understand the structure of the land- 
scape for other multiobjective combinatorial optimization problems. However, an 
appropriate model to estimate the number of local optima for any problem size 
still needs to be properly defined. A possible path is to generalize the approach 



from [14j for the multiobjective case. For a more practical purpose, our results 
should also be put in relation with the type of the problem under study, in par- 
ticular on how to compute or estimate the problem-related measures reported in 
this paper. Moreover, we mainly focused our work on the number of local optima. 
The next step is to analyze their distribution by means of a local optima net- 
work |15| . At last, we already know that the number and the distribution of local 
optima have a strong impact on the performance of multiobjective mctaheuris- 
tics, but it is not yet clear how they exactly affect the search. This open issue 
constitutes one of the main challenge in the field of fitness landscape analysis 
for multiobjective combinatorial optimization. 

References 

1. Kauffman, S.A.: The Origins of Order. Oxford University Press, New York, USA 
(1993) 

2. Paquete, L., Schiavinotto, T., Stiitzle, T.: On local optima in multiobjective com- 
binatorial optimization problems. Ann Oper Res 156(1) (2007) 83-97 

3. Borges, P., Hansen, M.: A basis for future successes in multiobjective combinato- 
rial optimization. Technical Report IMM-REP-1998-8, Institute of Mathematical 
Modelling, Technical University of Denmark, Lyngby, Denmark (1998) 

4. Paquete, L., Stiitzle, T.: Clusters of non-dominated solutions in multiobjective 
combinatorial optimization: An experimental analysis. In: Multiobjective Pro- 
gramming and Goal Programming. Volume 618 of Lecture Notes in Economics 
and Mathematical Systems. Springer (2009) 69-77 

5. Knowles, J., Corne, D.: Towards landscape analyses to inform the design of a 
hybrid local search for the multiobjective quadratic assignment problem. In: Soft 
Computing Systems: Design, Management and Applications. (2002) 271-279 

6. Garrett, D., Dasgupta, D.: Multiobjective landscape analysis and the generalized 
assignment problem. In: Learning and Intelligent OptimizatioN (LION 2). Volume 
5313 of Lecture Notes in Computer Science. Springer, Trento, Italy (2007) 110-124 

7. Garrett, D., Dasgupta, D.: Plateau connection structure and multiobjective meta- 
heuristic performance. In: Congress on Evolutionary Computation (CEC 2009), 
IEEE (2009) 1281-1288 

8. Aguirre, H.E., Tanaka, K.: Working principles, behavior, and performance of 
MOEAs on MNK-landscapes. Eur J Oper Res 181(3) (2007) 1670-1690 

9. Verel, S., Liefooghe, A., Jourdan, L., Dhaenens, C: Analyzing the effect of objective 
correlation on the efficient set of MNK-landscapes. In: Learning and Intelligent 
OptimizatioN (LION 5). Lecture Notes in Computer Science. Springer, Rome, 
Italy (2011) to appear. 

10. Coello Coello, C.A., Dhaenens, C, Jourdan, L., eds.: Advances in Multi-Objective 
Nature Inspired Computing. Volume 272 of Studies in Computational Intelligence. 
Springer (2010) 

11. Merz, P.: Advanced fitness landscape analysis and the performance of memetic 
algorithms. Evol Comput 12(3) (2004) 303-325 

12. Hotelling, H., Pabst, M.R.: Rank correlation and tests of significance involving no 
assumptions of normality. Ann Math Stat 7 (1936) 29-43 

13. Knowles, J., Corne, D.: Bounded Pareto archiving: Theory and practice. In: 
Metaheuristics for Multiobjective Optimisation. Volume 535 of Lecture Notes in 
Economics and Mathematical Systems. Springer (2004) 39-64 



14. Eremeev, A.V., Reeves, C.R.: On confidence intervals for the number of local 
optima. In: Applications of Evolutionary Computing (EvoWorkshop 2003). Volume 
2611 of Lecture Notes in Computer Science. Springer, Essex, UK (2003) 224-235 

15. Daolio, F., Verel, S., Ochoa, G., Tomassini, M.: Local optima networks of 
the quadratic assignment problem. In: Congress on Evolutionary Computation 
(CEC 2010), IEEE (2010) 1-8 



i 25 



35 



30 



p=-0.2 
p=0.0 
p=0.2 
p=0.9 



-X - 

— ^- 



.5 20 



Q. 
T3 



15 



10 



I ' ' ' ^ 1 

20 40 60 80 100 120 140 

N 




20 40 60 80 100 120 140 



